The Annals of Probability 

2004, Vol. 32, No. 2, 1391-1418 

DOI: 10.1214/009117904000000243 

© Institute of Mathematical Statistics, 2004 



A UNIFORM FUNCTIONAL LAW OF THE LOGARITHM FOR 
THE LOCAL EMPIRICAL PROCESS 

By David M. Mason 1 

University of Delaware 

We prove a uniform functional law of the logarithm for the local 
empirical process. To accomplish this we combine techniques from 
classical and abstract empirical process theory, Gaussian distribu- 
tional approximation and probability on Banach spaces. The body of 
techniques we develop should prove useful to the study of the strong 
consistency of d-variate kernel-type nonparametric function estima- 
tors. 

1. Introduction. Let U, U\, U2, ■ ■ ■ , be a sequence of independent Uni- 
form [0, 1] random variables. Consider for each integer n > 1 the empirical 
distribution function based on U\, . . ., U n , 

n 

G n (t)=n~ 1 J2l{U i <t}, -oo<t<oo. 

i=l 

Stute (1982a) was the first to initiate a concerted study of the almost sure 
behavior of the oscillation modulus of the uniform empirical process, which 
for any positive < h < 1 is defined to be 

w n {h) = sup{\y/n{G n (t + s) - G n (t) - s}\ :0 < t, t + s<l, 0<s<h}. 

He proved that whenever {/i n } n >i is a sequence of positive constants con- 
verging to zero at a certain rate [see (H.i-ih)], then the following uniform 
law holds: 



(1.1) lim w n (h n )/V2h n log(l//i n ) = 1 a.s. 

n — >oo 

Now more generally let Z, Z\, Z2, . . . , be i.i.d. random variables taking val- 
ues in ]R with common Lebesgue density function /. Stute (1982b) obtained 



Received June 2001; revised April 2003. 

Supported in part by NSA Grant MDA904-02- 1-0034 and NSF Grant DMS-02-03865. 
AMS 2000 subject classifications. 60F05, 60F15, 62E20, 62G30. 

Key words and phrases. Empirical process, kernel density estimation, consistency, large 
deviations. 

This is an electronic reprint of the original article published by the 
Institute of Mathematical Statistics in The Annals of Probability. 
2004, Vol. 32, No. 2, 1391-1418. This reprint differs from the original in 
pagination and typographic detail. 

1 



2 



D. M. MASON 



from (1.1) and the probability integral transformation a uniform strong law 
for the kernel density estimator f n over compact intervals J; namely, he 
showed that under certain regularity conditions on /, 

lim ^/^sup{\f n (z)-Ef n (z)\/\/2\\K\\ 2 2 f{z)log(l/h n )} = l a.s., 

(1.2) 

where f n is defined, for z € R, to be 

n 

(1.3) /„(*) = (nh n )- l Y,K(h-\z - Zi)), 

i=i 

with being a kernel with compact support and of bounded variation sat- 
isfying 

(1.4) 0< / K 2 (x)dx= \\K\\l <oo. 

JR 

Later, Stute (1984a) established a version of his strong law (1.1) for cer- 
tain oscillations of the empirical process based upon Z\, Z%,..., i.i.d. d- 
dimensional random vectors with common Lebesgue density function /. He 
used it to derive precise results on the uniform consistency of the <i-variate 
kernel density estimator, which is defined as in (1.3), but with the h n inside 
K replaced by h l J d . 

Deheuvels and Mason (1992) extended the Stute (1982a) strong law (1.1) 
to a uniform functional law of the logarithm (UFLL) for the cluster of ran- 
dom increment functions on [0, 1] , 

(1.5) {Cn(t,-):0<t<l-h n }, 

where, for each < t < 1 — h n , £ n (t, •) is the function defined on [0, 1], 

(1.6) £ n {t,s) = yJ^/K{G n (t + h n s)-G n {t)-h n s}, 0<a<l, 

and applied it to obtain exact rates of strong consistency for a number 
of nonparametric density estimators. (See Corollary 3 for a statement of 
this result.) Motivated partially by their work, Einmahl and Mason (2000) 
developed techniques from general empirical process theory and combined 
them with methods from Deheuvels and Mason (1992) to establish the pre- 
cise rate of strong consistency over compact intervals for certain kernel-type 
nonparametric function estimators. Their results improved upon those of 
Hardle, Janssen and Serfling (1988), who had obtained only approximate 
rates. As a byproduct, they were able to obtain the Stute (1982b) result (1.2) 
through an approach based upon viewing {f n (z) — Ef n (z) : z G J} as an em- 
pirical process indexed by the class of functions {h^ 1 K(h~ 1 (z — ■)) :z G J}. 
They also pointed out that the d-variate version of (1.2) could be derived in 
the same way. Gine and Guillou (2002) have recently done this and proved 
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the somewhat unexpected result that whenever K is continuous on K with 
support contained in [—1/2, l/2] d , and satisfies some additional assumptions 
(see Example F.l), the density / is uniformly continuous on W 1 and {h n } n >i 
satisfies conditions (H.i-iii), then 

lim sup \/nK\f n (z) - Ef n (z)\/V 2\\K\\l log(l//t n ) 

(1-7) / 

= sup v /(z) a.s. 

[Somewhat earlier, Deheuvels (2000) proved a dimension 1 version of this 
result.] We will derive a UFLL version of (1.7) as a corollary to our main 
result. 

The proof of the Deheuvels and Mason (1992) UFLL for (1.5) was strongly 
based on the Komlos, Major and Tusnady (KMT) (1975) Wiener process 
approximation to partial sums of i.i.d. Poisson random variables, coupled 
with a functional large deviation result for the Wiener process. Such a precise 
and powerful strong approximation as given by KMT does not exist in the 
general empirical process setting. 

Our goal in this paper is to show how one can meld the techniques from 
classical and abstract empirical process theory, Gaussian distributional ap- 
proximation and probability on Banach spaces to prove a UFLL for a general 
indexed by class of functions version of (1.5) formed by a sequence of i.i.d. 
random variables Zi, Z2,..., taking values in M. d with common Lebesgue 
density function /. The basic ingredients of our approach, along with their 
sources, are the following: 

1. Poissonization [Einmahl (1987), Deheuvels and Mason (1992) and Gine, 
Mason and Zaitsev (2003)]. 

2. The Talagrand (1994) exponential inequality for the empirical process 
indexed by functions. 

3. Tight bounds for the absolute moment for the supremum of the empirical 
process under a uniform covering number bound [Einmahl and Mason 
(2000) and Gine and Guillou (2001)]. 

4. Gaussian distributional approximation of multivariate sums [Zaitsev (1987a, b)]. 

5. Functional large deviation results for stochastic processes [Arcones (2003, 
2004)]. 

We shall see that our approach is powerful enough to obtain the Deheuvels 
and Mason (1992) UFLL (without the use of KMT) as a corollary of our 
main result. The methods and results developed in this paper should be of 
potential application to the investigation of the strong consistency of a vari- 
ety of multivariate nonparametric function estimators. To see how to apply 
the UFLL for the increment functions of the uniform empirical process to 
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obtain exact rates of strong consistency for a number of univariate nonpara- 
metric density estimators, refer to Section 3 of Deheuvels and Mason (1992). 
Our main results are stated in Section 2, several examples are detailed in 
Section 3 and all the proofs are given in Section 4. 

2. Main results. Let Z, Z\, Z%, ■ ■ ■ , be i.i.d. ci-dimensional random vec- 
tors with common Lebesgue density function /. Throughout this paper Q 
will denote a class of measurable real valued functions defined on R d , which 
have support contained in I d := [—1/2, l/2] d and are bounded by some k > 0. 
Let | • 1 2 denote the usual Euclidean norm on R rf . Assume that the class Q 
satisfies: 

(G.i) lim^i^o sup 9eg / Rd [g(x) - g(x + w)] 2 dx = 0; 
(G.ii) lim A _>i sup 9gg / Rd [g{x) - g(Xx)] 2 dx = 0. 

In addition, let T denote the class of functions formed from Q satisfying: 
(F.i) for each A > 1, z G R d and g G G, g(z - • A) G F. 

To avoid using outer probability measures in all of our statements, we 
impose the measurability assumption: 

(F.ii) T is a pointwise measurable class; that is, there exists a countable 
subclass J-q of J- such that we can find, for any function g G a sequence 
of functions {g m } in -^o for which g m (z) — ► g(z), z G U. d . [See Example 2.3.4 
in van der Vaart and Wellner (1996).] 

Finally we shall require the following entropy condition on the class T . 
For e > 0, let N(e,J r ) = supg N{ne,!F, c^q), where the supremum is taken 
over all probability measures Q on (Hl d ,B), dQ is the L2(Q)-metric, and, as 
usual, N(e,J r ,dQ) is the minimal number of balls {g-dQ(g,g') < e} of fig- 
radius e needed to cover T . Assume that T satisfies the following uniform 
entropy condition: 

(F.iii) for some C > and u > 0, JV(e, T) < C £~ v °, < e < 1. 

Let {h n } n >i be a sequence of positive constants less than 1 converging to 
zero. Choose any z G M. d . The local empirical process at z indexed by g G Q 
is defined to be 

n 

(2.1) E n (z,g) := (n^)" 1 / 2 EM/^ 1 ^ - Z t )) - Eg(br^ d {z - Z))}. 

i=l 

Einmahl and Mason (1997, 1998) obtained central limit theorems, strong 
approximations and functional laws of the iterated logarithm for the local 
empirical process at a fixed z. [Mason (1988) had treated a special case 
of this process, which he called the tail uniform empirical process.] They 
showed how to apply their results to obtain the exact rate of pointwise 
consistency for a number of well-known nonparametric kernel-type function 
estimators. The definition of the local empirical process given by Einmahl 
and Mason (1997, 1998) is a bit more general in that the hl/ d is replaced by a 
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sequence of bi-measurable functions. It extends an earlier notion introduced 
by Deheuvels and Mason (1994). 

It is our aim to study the uniform limiting behavior of this process as z 
moves over a compact set J. Towards this end we introduce the following 
normed versions of E n : For any z G K d and g G Q, set 

(2.2) D n (z,g) :=E n (z, g)/y/2 log(l//i n ) 
and if f(z) > 0, set 

(2.3) L n (z,g):=E n (z,g)/V2log(l/h n )f(z). 

We will assume that the sequence {h n } n >i converges to zero at the following 
rate: 

(H.i) h n \ 0, nh n / oo; 
(H.ii) nh n /\og(l/h n ) — ► oo; 
(H.iii) log(l//i n )/loglogn->oo. 

Consider the inner product defined for g\ , g2 G Q by 



(2.4) ( gii g 2 )-= gi (u)g 2 (u)du. 

Let G2(I d ) be the Hilbert subspace of L2(I d ) spanned by Q. Now let S denote 
its reproducing kernel Hilbert space generated by the inner product (•,•)• 
Applying Theorem 4D of Parzen (1961), the space S can be represented 
as follows: Let loo{Q)-, denote the class of bounded functions on Q. For any 
^ G G2{I d ), denote ip^ G loo{G) by (p^{g) := (g,Q, g^Q- Each ^ is uniquely 
defined by £ in the sense that tp^ = ip^ 2 if and only if = in L2(I d ). The 
space 5 = {^:(GG 2 (I d )} has the inner product 

(2-5) (<Pti><Pto) •■=&>&)■ 

Let So denote the unit ball in S and, for any •& G Sq and e > 0, set 

(2.6) £ £ 0?) = {y>GU£):|lV> 

where for any class of functions C and ip G loo(C), the class of bounded 
functions on C, 

(2.7) ||^|| c = sup|^)|. 

gee 

Finally, write for any e > 0, 

(2.8) 5 £ = {</> G MS) : inf U - <&\\g < ej. 

Throughout this paper J will denote a compact subset of M. d with nonempty 
interior. For any 7 > 0, we set 



(2.9) J 7 = < x : inf \x — z\ 2 < 7 

Our UFLL for the local empirical process is given in the following theorem. 



G 



D. M. MASON 



Theorem 1. In addition to assumptions (G.i-ii), (F.i-iii) and (H.i-iii), 
assume that, for some 7 > 0, the density f is continuous and positive on J 7 . 
Then with probability 1: 

(a) for all e > 0, there exists an n(e) such that, for each n > nie), {L n (z, •) : 
ze J}C.Sg; 

(b) for any ■& 6 So and e > 0, there is an n(#, e) such that, for all n > 
7i(t?,e), i/iere is a z n EJ such that L n (z n ,-) £ B e (d). 

Remark 1. It has long been recognized that the polynomial covering 
number assumption (F.iii) is the natural condition to impose upon the in- 
dexing class, when studying the local behavior of the empirical process. For 
instance, when Alexander (1987) made the first steps toward the investiga- 
tion of the increments of the empirical process in a general indexed by a class 
of sets framework, he considered classes of index sets, which satisfy (F.iii). 
Nolan and Pollard (1987) and Nolan and Marron (1989) pointed out how 
the assumption (F.iii) on the class J- arises naturally when investigating the 
large sample behavior of the kernel density estimator via empirical process 
indexed by a class of functions theory. (See Example F.l.) Later, Rio (1994) 
found that (F.iii) was the right assumption to impose on T when he derived 
his local invariance principle for the uniform ([0, l] d ) empirical process in- 
dexed by a class of functions, and applied it to kernel density estimation; 
as did Einmahl and Mason (1987, 2000, 2003) in their treatment of local 
empirical processes, Gine and Guillou (2002) in their derivation of rates of 
strong consistency for multivariate kernel density estimators and Deheuvels 
and Mason (2004) in their construction of universal confidence bands for 
regression functions. Classes of functions satisfying (F.iii) play a featured 
role in Devroye and Lugosi's (2000) derivation of bounds in the L\ error for 
certain kinds of density estimators. This assumption also plays a critical role 
in the work of Gine, Koltchinskii and Wellner (2003) on ratio limit theorems 
for empirical processes. 

Remark 2. Condition (F.iii) was imposed to ensure that the moment 
bound (4.21) given in Fact 5 holds uniformly over all the classes of indexing 
functions considered in the proof of Theorem 1. One may surmise that (F.iii) 
could be replaced by a less restrictive entropy assumption. However, it is 
not clear whether this is the case. For a closely related discussion of this 
assumption, as it pertains to a local Gaussian process version of Theorem 
1, see Mason (2003). 

Remark 3. It is routine to modify the proof of Theorem 1 to show that 
it remains true when (F.iii) is replaced by the bracketing condition: 

(F.iii)' for some C > and u > 0, N [ . ] (s,J r ,L 2 (P)) < C e- U °, < e < 1. 
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Refer to page 270 of van der Vaart (1998) for the definition of iVj.j (e, J 7 , L/2(P)). 
Essentially all that one has to do is to substitute the use of Fact 5 below by 
Lemma 19.34 of van der Vaart (1998). 

Theorem 1 should be compared with the following functional law of the 
iterated logarithm at a fixed z G M rf that can be inferred from Corollary 1.1 
of Einmahl and Mason (1997), namely, that with probability 1 the sequence 
of processes indexed by g G G, 

{E n (z,g)/y/2loglog(l/hn)f(z), g G G}, 

is relatively compact in loc(G) with set of limit points equal to Sq. We see that 
to describe the behavior of E n (z,g) at a fixed point z G M. d , the ^/log(l//i„) 
norming must be replaced by y/log log(l//i n ). 

The following corollary provides a UFLL version of the Gine and Guillou 
(2002) result cited in (1.7). 

Corollary 1. In addition to assumptions (G.i-ii), (F.i-iii) and (H.i- 
iii), assume the density f is uniformly continuous on M. d . Then with proba- 
bility 1: 

(a) for all e > 0, there exists an n(e) such that, for each n > n(e), {D n (z, ■) : z G 
R d } C {t S : z G R d } £ , where r = sup 26R d y/f{z); 

(b) for any z G M. d , $ G So and e > 0, there is an n(i?,z,e) such that, for 
all n > n(i?,^,e), there is a z n G M. d such that D n (z n , •) G \J f{z)B e { r d) and 

\z n - z\2 < E. 

To see how Corollary 1 implies the Gine and Guillou (2002) result (1.7), let 
G = {K}, where K is continuous on M. d with support contained in [—1/2, l/2] d , 
and satisfies the conditions of Example F.l. Then assumptions (G.i-ii), (F.i- 
iii) and (H.i-iii) are satisfied. In this case Sq = {ip^ : £ = uK/\\K ||2 for some \u\ < 
1} and clearly sup{|^(if)| :(f£ G So} = \\K ||2, from which (1.7) readily fol- 
lows from parts (a) and (b) of Corollary 1. 

Further examples are detailed in Section 3. 

3. Examples. What classes of functions satisfy conditions (G.i-ii)? Using 
continuity of the shift and scale operators in L2(M rf ), it is trivial to see that 
(G.i-ii) hold for any class of functions G on M. d which is the convex hull of 
a finite number of L2(M. d ) functions. Here are some important classes that 
satisfy conditions (G.i-ii). 

Example G.l. Consider the class of functions G c ={^c'-C is convex, 
closed and contained in I d }. Choose any 1q G Gc, < r < 1 and w G M. d 
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satisfying \vj\2 <r; then 



f [l c (x) - t C (x + w)f dx = \CA(C -w)\< \C r AC\ + \C r A(C - w)\ 



= 2{\C r \-\C\}, 



where A denotes symmetric difference, C r = {x : \ x — x/ 1 2 < r for some y G C} 
and \A\ signifies the Lebesgue measure of a measurable set A. Now by the 
Steiner formula [see page 14 of Stoyan, Kendall and Mecke (1995)], we can 
conclude that, there exists a positive constant c<j such that, for all C convex, 
closed and contained in I d , and < r < 1, we have \C r \ < \C\ + c^r. Thus 
2{|C r | — |C|} < 2Qr, which easily implies that the class satisfies condition 
(G.i). Condition (G.ii) is also readily verified. 

Example G.2. Let Q be a bounded equicontinuous class of functions 
on R d with support in I d . Prom the inequality 

/«,)-,(,+.,]»*= r w .)M.)-^ + -)M. + .)i'* 



it is straightforward to show that condition (G.i) holds using the fact that 
the class of functions Q is bounded and uniformly continuous in combination 
with Example G.I. Condition (G.ii) is checked in the same way. 

Notice that the class Q + = {ag + bio '■ 9 £ 0, tc £ Gc and \a\ + |6| < D}, 
where < D < 00 and Q is any class of functions as in Example G.2 satisfies 
conditions (G.i-ii). 

What about classes of functions T that satisfy all the conditions (G.i-ii) 
and (F.i— hi)? 

Example F.I. Set Q = {K}, where K is continuous with support in 
I d . Furthermore, whenever d = 1, assume K is of bounded variation on 
M, and whenever d>2, that K is of the form K{x) = ${x T Ax), for some 
d x d matrix A and bounded continuous real valued function <1> of bounded 
variation on M. Obviously (G.i-ii) hold for Q. The class Tk = {K{z — ■ A) : A > 
1 and z £ M d } satisfies (F.i) by construction and (F.iii) by the results in 
Section 5 of Nolan and Pollard (1987). Also (F.ii) is readily verified using 
continuity of K. 

Example F.2. Let Qr = {1r : RelZ}, where 1Z = class of closed rect- 
angles contained in I d , or Ge = {^E- E G £}, where £ is the class of closed 
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ellipsoids contained in I d . Clearly, since Qr and Qe are subsets of Q c , con- 
ditions (Gi-ii) hold for both classes. Set 

(3.1) T R = {l R (z - -A) : 1r G Qr, A > 1 and z G R d } 
and 

(3.2) T E = {1e{z - -A) :1e£Ge, A > 1 and z G R '}. 

It is well known that both the set of all closed rectangles and the set of all 
closed ellipsoids in M. d form Vapnik-Chervonenkis (V.C.) classes; therefore, 
both J-r and Te clearly satisfy (F.i) and (F.ii) . [See van der Vaart and 
Wellner (1996) for the definition of a V.C. class, along with exercise 9 on 
page 151 of their book.] Finally, (F.iii) is readily verified for both Tr and 

Observe that the class of functions 

T+ = {agi + bg 2 :g\ € F K , 92 G Fr and \a\ + \b\ < D}, 

where < D < oo, is easily shown to satisfy (G.i-ii) and (F.i-iii). This class 
should suffice for most applications. 

The following corollary provides a UFLL version of Theorem 2.1 of Stute 
(1984). 

Corollary 2. Let {h n } n >i satisfy (H.i-iii) and let Qr and J-r be de- 
fined as above. Assume that, for some 7 > 0, the density f is continuous and 
positive on [a\ — 7, b\ + 7] x • • • x [aj, — 7, b^ + 7], where —00 < ai < bi < 00, 
i = 1, . . . , d. Then with probability 1: 

(a) for all e > 0, there exists an n(e) such that, for each n > n{e), {L n (z, •) : 
z G J} C Sq, where J = [ai,b\] x • • • x [a^, b^] and 

S = I f : ip(t R ) = I ±r(x)£(x) dx for t R G Qr 

(3.3) 

with £ satisfying 



j id e( x )dx<iy, 



(b) for any $ G So and e > 0, there is an n($,e) such that, for all n > 
n(-d,e), there is a z n £ J such that L n (z n , •) G B e (-d). 

Notice that it is readily checked that, for So in (3.3), sup ¥ , g 5 sup lflg g; fl |(^(lL/j)| = 1, 
which on account of parts (a) and (b) of Corollary 2 implies that lim n ^oo sup lRe g R \L n (l R ) 
1, a.s. 

We end this section by showing how the UFLL for the increment functions 
of the uniform empirical process given in Theorem 3.1 of Deheuvels and 
Mason (1992) can be derived from Theorem 1. First note that the proof of 
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Theorem 1 shows that it remains true when I d is replaced by any compact 
c?-dimensional cube. In particular, in dimension 1, Theorem 1 holds with / 
replaced by [0,1]. Next, the classes of functions 

G = {t [0<t] :te [0,1]} and T = {l[ ,t](z - -A) :t G [0, 1], A > 1 and z G R} 

are readily shown to satisfy (G.i-ii) and (F.i-iii), respectively. Furthermore, 
in this setup, 



Recalling the notation in (1.5) and (1.6), set for each n > 1 and t G [0, 1 — h n ] , 



Assume that {/i n }n>i satisfies (H.i-iii). Clearly, when the underlying distri- 
bution function is Uniform [0, 1], we can apply Theorem 1 to infer that, for 
any choice of < 7 < 1/2 and for each e > 0, there exists an n(e) such that, 
for any n > n(e), {£ n (t, •) - t G [7, 1 — 7]} C Sq. Combining this with (1.1), 
which implies that 

(3.5) lim lim uj n (h n 'y) / V 2h n log(l / h n ) = a.s., 

we obtain from Theorem 1 the following corollary, which is Theorem 3.1 of 
Deheuvels and Mason (1992). [Alternatively, in place of (1.1), we could have 
proved (3.5) by an argument based on Inequality 1.] 

Corollary 3. Let {h n } n >i satisfy (H.i-iii). Then with probability 1: 

(a) for all e > 0, there exists an n(e) such that, for each n > n{e), {£ n (t, ■) : t G 
[0,1 -K]} C<Sg and 

(b) for any •& G Sq, [a, b] C [0, 1], with a <b, and e > 0, there is an n($, e) 
such that, for all n > n($,e), there is at n £ [a,b] such that £ n {t n , •) G B £ ($). 

4. Proofs. 

4.1. Proof of part (b) of Theorem 1. 

4.1.1. A large deviation result. Set, for n > 1, 



(3.4) 





£n(t, •) = £„(t, •)/v / 21og(l/^). 



(4.1) 



&n = V2nh n log(l//i n ). 
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Crucial to our proof is the following uniform large deviation result. Let 
rj n be a standard Poisson random variable with rate n, independent of 
Z, Z\, Z2, ■ ■ ■ , and consider the Poissonized version of the L n process: 

U n (z,g) := (bn^fizj)- 1 ^(diK^iz - Z,)) - Eg(h; i 1 ' d (z - Z)% 

i=i 

where the empty sum is defined to be zero. 

Define the rate function /(•) on 1^(0) as follows. For any if; G Iqo(G), 

\ J £, 2 ( u ) du, iiip = ip ( for some £ G G 2 (I d ), 
00, otherwise. 

Recall the definitions of ip^ and G2(I d ) between (2.4) and (2.5) in Section 
2. Also denote for any subset B C l<x>(G), 

(4.3) I(B)=mi{I(^):^£B}. 

We endow loo(G) with the topology generated by the norm || • defined as 
in (2.7). 

Proposition 1. Under the assumptions of Theorem 1, for any sequence 
{mn}n>i of positive integers and any triangular array of points Zi^ n , i — 
1, . . . , m n , n > 1, in J, we have: 

(i) for all closed subsets F ofl^Q), 

limsup max £ n logP{LF; n (-) G F} < -1(F); 

n.-+oo l<i<m n 

(ii) for all open subsets G of 1^(0) , 

liminf min e n logP{IL;, n (-) G G} > -1(G), 

n— >oo l<i<m n 

where U itn (-) = U n (z^ n ,-), i = l,.. . ,m n , n > 1 and 

(4.4) e n = (21og(l// ln ))- 1 . 

4.1.2. Proof of Proposition 1. We will take advantage of some recent 
work of Arcones (2003, 2004). In fact, we shall require the following trivial 
generalization of Theorem 3.1 of Arcones (2003). In the statement of this 
result, P* and P* denote the usual outer and inner measures associated 
with P, and A and A° denote the closure and interior of A, respectively. 
Let Iqo(T) denote the space of bounded functions on T. Also LDP is short 
for large deviation principle, as defined, for instance, in Arcones (2003). 
Note that a basic ingredient of Fact 1 is the uniform exponential tightness 
condition (A. hi). 
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FACT 1. Let {Xi <n (t) :t G T, 1 < i < m n }, where {m n } n >i is a sequence 
of positive integers, be a triangular array of stochastic processes and let T be 
an index set. Let {e„,} n >i be a sequence of positive numbers that converges 
to zero. Let g be a pseudo-metric on T. Consider the following conditions: 

(A.i) (T, q) is totally bounded. 

(A.ii) For each choice of t±, . . . ,t k G T, the triangular array of vectors 
{(JQ n (ti), . . . ,Xj n (tfc)),l < i < m n } satisfies uniformly the LDP with speed 
e n and good rate function Itx,...,t k > i n the sense that, for any Borel subset 
AcM. k , 

- inf I tl ,...,t h (z) <liminfe n min logP*{pQ , n (*i), • ■ • ,n(*fc)) G A} 

z£A° n^oo l<i<m n 

<limsupe n max log P*{(X in (ti ),..., X itn (t k )) G -4} 

n-+oo l<i<m„ 

< - inf /^...^(z), 

and for any < a < oo, the set {z G M fc : /^...^(z) < a} is a compact set in 
(A.iii) For eac/i r > 0, 
limlimsupe n max logP*< sup |Xj — X{ n (s)| > r > = — oo. 

V~>0 n-*oo l<i<m n l e (s,i)<v J 

Then, for each < a < oo, the set {tp G loo(T) : I(ip) < a} is a compact set 
in loo(T), where 

/(V) = sup{I tl ,...,t fc (V'(ti) ) • • .,ip(t k )):h, .. .,t k G T, fc > 1}. 

Moreover, one gets the following upper and lower bounds in the LDP with 
respect to outer and inner probabilities (because of possible lack of measur- 
ability): For each A C loo(T), 

— inf I (ib) < liminf e n min logi^jAj n G A} 

ip&A° ra->oo l<i<m„ 

< limsupe n max logP*{Aj in G ^4} < — inf_ 

n^oo l<i<m„ ^, G ^4 

Also we will require the following fact, which follows by applying Theorem 
5.2 of Arcones (2004) to a finite index set T. 

Fact 2. Let {Ui tn (t) : t G T, 1 < i < m n } be a triangular array of centered 
Gaussian random vectors, where {m n } n >i is a sequence of positive integers 
andT = {ti, . . . ,td} is a finite index set. Let {e n }n>i be a sequence of positive 
numbers that converges to zero as n — > oo. Assume that for a covariance 
matrix R = {R(ti,tj) : (U,tj) G T 2 }, we have, for any s,t G T, 

(4.5) lim max \R(s,t) - e~ x E[U i>n (s)U iin (t)}\ = 0. 
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Then for any Borel subset A C M. d , 

(4.6) 

<limsupe n max logP{U i>n G A} < - inf It lr ..,t d {z), 

n— »oo l<i<m n Z £A 

where for z E M d , 

(4.7) I tl ,... )td (z) = inf{2- 1 e T i^ : R£ = z). 

The following lemma, which is a special case of a result of Stein [(1970), 
pages 62 and 63], will come in handy. 

Lemma 1. Let f be a Lebesgue density function on which for some 
7 > is bounded and uniformly continuous on L> 7 , where D is a closed subset 
ofM. d and D 7 is defined as in (2.9). Then for any L±(M. d ) function H , which 
is equal to zero for x ^ I d , 

(4.8) sup\f*H h (z)-I(H)f(z)\^0 ash\0, 

where 1(H) = f Rd H(u) du and f * Hh(z) := h~ l f Rd f(x)H(h~ l / d (z — x)) dx. 

Choose Q q = {gi,...,g q }cQ and z lj7l , . . . , z mnjn E J. Let {U i]7l (g) : g G Q q , 
1 < i < m n } be a triangular array of centered Gaussian random vectors each 
with covariance function 

o-i, n {gi,9k) = n(b 2 n f(zi, n ))~ l cov(gi(h~ 1/d (z ijn - Z)), g k (h~ l/d (z iyn - Z))), 

1 < i < m n . 

It is routine using Lemma 1 to show that, with e n as in (4.4), as n — > oo, 

(4.9) max max \e~ x a in {g h g k ) - cr(g h g k )\ 0, 

l<i<m n 1<',K<9 

where a{g h g k ) := J Id gi(u)g k (u) du. 

Thus Fact 2 applies here and its conclusion (4.6) holds with 

(4.10) R(gi,9k) = o-(gi,g k ). 

Consider now the triangular array of Poisson-type processes indexed by g G 

nj,„(g) := (b n Vf(z iin ) y 1 

(4.11) Vn 

x E(^n lA ^,n - Zj)) - Eg{K l l d (z hn - Z))), 
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1 < i < m n , n > 1. Notice that for each 1 < i < m n , the process {Ri,n(9)}g£g q 
has the same covariance function as the process {Ui tn (g)} g< =g q . We claim that 
for any Borel subset A C M q , 

- inf /„ g (z) < liminfe n min logP{U in £A} 

z£A° y yq n-*oo l<i<m n 

(4.12) < limsupe n max logP{IIj jn 6 A} 

?woo l<i<m n 

< - inf I fll ,..., fla (2), 

where e n is as in (4.4), and for z € M. q , I gi: ...^ q {z) is defined as in (4.7), with 
R as in (4.10). 

To show this we shall need the following result of Zaitsev (1987a). For 
probability measures P and Q on the Borel subsets of M 9 , q>l, and 5 > 0, 
let 

(4.13) X(P, Q, 5) := sup{P(^) - Q(A 5 ), Q(A) - P(A S ) :AcR q , Borel}, 

where A s denotes the 5- neighborhood of A, A s := {x £ M. q : mf y ^A \ x — y (2 < ^} 
Let P be an infinitely divisible g-dimensional distribution with spectral mea- 
sure concentrated on the ball {x E W 1 : \x\2 < (3} , (3 > 0, and let Q be the 
g-dimensional normal distribution with the same mean and covariance ma- 
trix as P. The following inequality is contained in Theorem 1.1 and Example 
1.2 of Zaitsev (1987a). See, as well, a slightly weaker statement in Theorem 
1.2 of Zaitsev (1987b). 

Fact 3. For all 5 > 0, 

(4.14) X(P, Q, 5) < ci i9 exp(-V(c 2 , g /3)), 

where Cj g < Qg 2 wii/i ci, C2 6em<? universal finite positive constants. 

It is easy to see that the distribution of (IIj :re (gx), • • • ,^i,n{dq)), being 
compound Poisson, is infinitely divisible with spectral measure, uniformly 
in 1 < i < m n , concentrated on the ball {x £ M q : \x\2 < /?}, where /? = 
p/ \Jnh n log(l//i n ) and p > is a constant. This follows from the fact that, 
for some p' > 0, uniformly in 1 < i < m n , n > 1, 

(6nV7(^0)- 1 b(^ 1/d (zi,n - Z,-)) - Egfa 1/d (zi, n - Z))\ 

< p' I Vnh n log(l//i n ). 

Hence by applying Fact 3, we see that uniformly in 1 < z < m n , 



(4.15) A(Pi !n) Qi jri ,(5) < ci ig exp(-5Vra/i n log(l//i rt )/(pc 2i(? )), 
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where Pj jn is the distribution of (IIj in (gx), ■ • ■ ,Hi, n (9q)) and Qi <n is the dis- 
tribution of (Ui tn (gi), . . . , Ui t n{g q )). Using (H.ii), it is easy to infer from 

(4.15) that, for each 5 > 0, as n — > oo, 

(4.16) max log(l/h„) _1 log A(Pj, n , Ck n , <5) -> -oo. 

l<i<m„ 

Therefore, since by (4.9) in combination with Fact 2, (4.12) holds with IIj n 
replaced by C/i n, we readily conclude from (4.16) that (4.12) is satisfied. 
Hence assumption (A.ii) of Fact 1 holds with e n as in (4.4). 

Our next goal is to verify that (A. hi) holds with T = Q. Let g denote the 
pseudo-metric on Q, 



(4.17) QM) = \ I (g(u)-g'(u)) 2 du, g,g' e 0. 

We shall show that for each r > 0, 

limlimsupe n max logP*^ sup \U in (g) - H Jg')\ > r \ = -oo. 
r?^0 n _>oc l<i<m n Le(g,s')<»7 J 

Observe that whenever rj n = m, for some m > 1, for g,g' G £/ and each 1 < 
i < m n , 

ni,n(s) - n i,n(5') 

m 

= (ftnvTK^))" 1 £{(S " sf){K 1,d {*i,n ~ Zj)) 

-E(g-g>)(h-V d (z i>n -Z))} 
= ■ (b n V f(z ijn ) )~ l T m ^ ny i(g - g'). 
Notice that we can choose < [3\ < fa < oo such that, for all z £ J 7 , 

(4.18) < ft < /(*) < (3 2 < oo. 
Thus for each 1 < i < m n , 

P[ sup |n i)n ( 5 ) - U hn (g')\ >t/v%] 
(4.19) < P\ max max sup \T m n Ag - g')\ > rb n \ + P{q n > 2n} 

{ l<i<m n l<m<2n g (g tg r)< v J 

■=Pn(T, rj)+P{r] n > 2n}. 

To finish the proof, we shall require two more facts and an inequality fol- 
lowing from them. 
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Let X, Xi,X2, ■ ■ ■ , be i.i.d. on a probability space (X,A,P). Let H be a 
pointwise measurable class of real valued functions defined on X. Further let 
ei, €2, . . . , be a sequence of i.i.d. Rademacher random variables independent 

of X\,X2, [By Rademacher, we mean P(e\ = 1) = P(e\ = —1) = 1/2.] 

Set, for each g & TC and m > 1, 

m 

(4-20) T m ( 5 ) = £{ 5 (X,) - £ 5 (X)}. 

j"=i 

We shall need the following inequality, which is essentially due to Tala- 
grand (1994). See Einmahl and Mason (2000). 



Fact 4. Let TC be a pointwise measurable class of functions on {X,A) 
satisfying, for some < M < oo, \\g\\x '■= sup xeX \9( x )\ — M, g G H. Then, 
for all n > 1 and t>0, we have, for suitable finite constants A\^Ai > 0, 



max \\T m \\ n >Ai\E 

Km<n \ 



i=l 



+ t 



H 



< 2[exp(-A 2 t 2 /na^) + exp(-A 2 t/M)], 
where = sup^g-^ Yai(g(X)). 



Let G be a finite valued measurable function satisfying, for all x G X, 
G(x) > sup 9gW and define 

N(e,H) = sup N(eVQ(G 2 ),n,d Q ), 
Q 

where the supremum is taken over all probability measures Q on (X,A) for 
which < Q(G 2 ) < oo and dQ is the L2(Q)-metric. As above, N(e,Tt,dQ) 
is the minimal number of balls {g-dq(g,g') < e} of c?Q-radius e needed to 
cover TC. 

We shall require the following moment bound of Einmahl and Mason 
(2000). [For a similar bound, refer to Gine and Guillou (2001).] 



Fact 5. Let TC be a pointwise measurable class of real valued bounded 
functions on (X,A) such that, for some constants j3,u,C > 1, a < 1/(8C) 
and function G as above, the following four conditions hold: 

Q{G 2 ) = EG 2 {X)<(5 2 ; 

N(e,H)<Ce- u , < e < 1; 

a 2 := sup Eg 2 (X)< a 2 ; 
g&H 
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and 



sup \\g\\ x < (2^/u + T) Vncr 2 /log(/3Vl/a). 
g&H 



Then we have, for a universal constant A3, 
n 



(4.21) 



E 



i=l 



< A 3 Vuna 2 log(/3 V 1/ct). 



We shall make frequent use of the next inequality, which follows readily 
from Facts 4 and 5. 



Inequality 1. Let {J- n }n>i be a sequence of classes of measurable real 
valued functions on M. d each bounded by M > and satisfying uniformly in 
n> 1, (F.ii-iii). Let {h n } n >i be a sequence of positive constants less than 1 
converging to zero at the rate (H.ii). Assume that, for some 7 > 0, for all n 
large, 



(4.22) 



o*:= sup Eg 2 (X)< 7 2 h n . 



Then with b n as in (4.1) ; there exist constants Dq > and D\ > such that, 
for all p> and all n large, 

Pn(p) ■■= pfmK ||T TO ||^ n > (7 + p)D l b n \ 

{l<rn<2n ) 

(4.23) < 2exp(-A)(/V7) 2 log(l//i ri )). 

Proof. First, by Fact 4, for suitable finite constants A\,A 2 > 0, 
r / 2n 



P max ||r m ||^>^ £ 

I l<m<2n \ 



e i9( X i 



i=l 



+ pb n 



< 2[exp(-A 2 pX/(2ra<)) + exp{-A 2 pb n /M)]. 

Now by using (4.22) with Fact 5, we get, for a suitable D\ > A\, for all n 
large, 



2d 



i=l 



< ^Dib n , 



which gives 



P n (p)<P\max \\T m y n >A 1 [E 



2n 



i=l 



+ pK 
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Therefore we readily conclude from Fact 4 that, for some constants D2,D% > 
0, 

P n (p) < 2exp(-D 2 (p/ 1 ) 2 log(l/h n )) + 2eM-D 3 pb n ), 
which by (H.ii) is, for some Dq > and all large n, less than or equal to 

2exp(-A ) ( /0 / 7 ) 2 log(l//i n )). □ 
Returning to the proof of Proposition 1, for any r] > 0, with q as in (4.17), 

let 

(4.24) H(ri) := {<? - g' : g(g, g') < r?, g, g' G G] 
and 

(4.25) n n (rf) = {(g - g'){h~ l l d (z hn -.)) :g -g'e H( V ), l<i<m n }. 
Using this notation, we can write p n (i~,r]) in (4.19) as 

( 4 -26) p n {T,rj)=P\ max \\T m \\ Hn{) > rb n \ . 

Clearly, by using the fact that each g — g' is uniformly bounded by M := 2k, 
we get, with D\ as in Inequality 1 that for some 5 > and all r/ > 0, 

(4.27) max sup E(g - g' filial d { Zi . n - Z)) < h n 5 2 r, 2 /Dl 
l<i<m ng _ g , eH(j) j 

Let T' = {g — g' : g, g' € J 7 }. Clearly, from (F.iii) we get that, for some C > 
and with v = 2u , N{e,F') < Ce~ u , < e < 1. 

Now for any r > and r] > such that rj5 < r/2, we see that 

Pn(T,r)) < P\ max ||T m || Wn( ) > (r]5 + T/2)b n \. 

^ \<m<2n ) 

Therefore, by (4.27) and TC n (i]) C J 7 ', we can apply Inequality 1 with 7 = 
r}5/D\ and p = t/(2Di) to show that, for all r > and sufficiently small 
r) > satisfying rj5 < r/2 and all n large enough, 

(4.28) p n (r,J7) <2exp(-4- 1 r 2 Z?o(rA ? ) 2 log(l//i n )), 
which implies that 

limsuplogp n (r,r ? )/(21og(l// in )) < -8^6~ 2 D (t / V ) 2 . 

n^oo 

Next, by Chebyshev's inequality applied to exp(^ n log 2), we get P{i] n > 
2n} < exp((l — 21og2)n), from which we obtain that 

lim logPK > 2n}/(21og(l//i n )) = -00. 
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Putting everything together, taking (4.19) into account, we conclude with 
e n = (21og(l//i n )t)- 1 , 

limlimsupe n max P< sup |IL re (#) - U in (g')\ > rj\[W\ 

r?-»0 n^oo l<i<m n lg( g> g')< TI 

< lim(-8^ 1 6- 2 D (T/rj) 2 ) = -oo. 

Tj— >0 

This shows that condition (A.iii) of Fact 1 holds. Assumption (F.iii) implies 
that (A.i) of Fact 1 is satisfied and we have already verified (A.ii) above. Thus 
we have checked all the conditions of Fact 1 and can infer that its conclusions 
hold for the triangular array of processes {IL in (-), i = 1, . . . , m n }. Finally, it 
can be deduced from Theorem 4.2 of Arcones (2004) that, in our situation, 
the as arises from Fact 1 has the representation (4.2). This completes 
the proof of Proposition 1. 

4.1.3. Poissonization. Choose z\ n , . . . , z mn n G J, and, for 1 < i < m n , 
let, for g G Q, 

n 

LtM := {b n ^~))- 1 Y J {9(K lld {^n - Zj)) - Eg{h?l d {zi, n - Z))). 

3=1 

We shall need the following special case of Lemma 2.1 of Gine, Mason and 
Zaitsev (2003). Its idea may be traced back to Pyke and Shorack [(1968), 
proof of Lemma 2.2], through Einmahl (1987) and Deheuvels and Mason 
(1992) [also see Einmahl and Mason (1997)]. For a further generalization, 
along with additional historical remarks, refer to Borisov (2002). 

Fact 6. Choose z± :n , . . . , z mn ^ n G J. Whenever 
(4.29) P i Z G ~ h}J d I d } < 1/2, 

i=l 

then for all Borel subsets B\,..., B mn of loo(G), 

P{L itU eBi,i = l,.. . ,m n } < 2P{IL in eBi,i = l,.. . ,m„}, 
where IIj jn is the Poissonized version of Li tU as defined in (4.11). 

Our next lemma completes the proof of part (b) of Theorem 1. 

Lemma 2. With probability 1, for any -d G So, and e > 0, there is an 
n($,e) such that, for all n > n($,e), there is a z n £ J such that 



(4.30) 



L n {z n ,-)eB £ ($). 
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Proof. Recall definitions (4.2) and (4.3). Choose any $ £ So with < 
i?) = 2/(i?) < 1 and e > small enough so that 

(4.31) < 2I(fl 6 (0)) < 1. 

Select zi >n , . . . , z mntn £ J such that the components of z^ n and Zj sn , i ^ j, 
differ in absolute value by more than hl/ d , (4.29) holds and 

(4.32) logm n /log(l//i n ) — > 1 asn^oo. 

The existence of such a sequence {m n } n >i is guaranteed by (4.18) and the 
assumption that J has nonempty interior, which implies that [a\, b%] x • • • x 
[ad, bd] C J, for some — oo < a, L < < oo, i = 1, . . . , d. 
We see by Fact 6 that 

P n = P{L i!n <£B e (ti), i = l,...,m n }<2P{U hn ^B E (^), i = l,...,m n }. 

Now by using the independence property of the Poisson processes Hi >n , 
1 < i < m n , following from the choice of the Zj jn , i = 1, .. . ,m n , and the 
assumption that the functions g have support in I d , this last bound equals 

2Y[P{U hn ^B e ^)}. 

i=l 

Applying part (ii) of Proposition 1, we see that this last expression is, for 
any p > and all n sufficiently large, 

< 2 [l - exp(-2(l + p)\og{l/h n )I(B e ($)))} m \ 

which, in turn, by (4.31) and an appropriate choice of < p < 1 is, for some 
< r < 1 and for all n sufficiently large, 

< 2[1 - exp(-rlog(l// ln ))] m " = 2(1 - < 2exp(-m n ^). 

Since we assume (4.32) and (H.iii), we see that, for all 7 > 1 and n large, 
Pn < exp(— (logn) 7 ), from which we readily conclude (4.30) by the Borel- 
Cantelli lemma. The case I($) = is readily inferred from the < 2J(f9) < 1 
case. □ 

4.2. Proof of part (a) of Theorem 1. 

Lemma 3. For some constant C > independent of the sequence {h n } n >i, 
with probability 1, 

(4.33) limsupsupsup \L n (z,g)\ < C. 

n^oo zg J g^Q 
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Proof. The proof will be obtained by blocking between 2 k and 2 fc+1 
and using Inequality 1. Notice that for a suitable r > 0, for all large k, 

max sup sup Eg 2 (h~ 1/d (z - Z)) < T 2 h n , k , 

2 k <n<2 k + 1 Z& J g€ g 

with nfc := 2 k , k = 1, 2, Set for = 1, 2, ... , 

^ +1 =Wrt-)):9ee, ZGJ, 2 fe <n<2 fc+1 }. 

Now for any p > and Do as in Inequality 1 with f3\ as in (4.18), we get, 
using h n \og(l/h n ) \, that 

P< max supsup |L n (z,5)| > V2(t + p)D 1 / y//3^ } 

L2fe<n<2fc+l 2 gJ g€ g ) 

< Pi max ||T„||^ > (r + p)D 1 b n \, 

which since •7 r n fe+1 satisfies (F.ii-iii), is, by Inequality 1, 

<2exp(- J D (p/r) 2 log(l// lnfc+1 )). 

Notice that by (H.iii), we have log(l//i nfc+1 )/log(A;) — > oo, which in combina- 
tion with this last bound and the Borel-Cantelli lemma implies that (4.33) 
holds with C = y/2{r + p)D 1 / y /(% for any p > 0. □ 

Write now, for any 7 > 0, 
(4.34) y k = [(l +1 ) k ] for fc = 1,2, — 



Lemma 4. With probability 1, 
(4.35) limlimsup max \b n /b Uk — 1| supsup \L n (z, g)\=0 

7\0 fc^oo v k <n<v k+l zeJ ge g 



and 
(4.36) 

- £n(2,5)| = 0. 



limlimsup max supsup(& n /6^ fe+1 )|L n (z, g{{h n /h Uk+1 ) l/d ■ )) 



Proof. The proofs of (4.35) and (4.36) follow closely those of Lemmas 
3.5 and 3.6 of Deheuvels and Mason (1992). Lemma 3 is used to establish 
(4.35). The proof of (4.35) is based on Inequality 1 using condition (G.ii). 
We omit the routine details. □ 



22 D. M. MASON 



By condition (G.i) and compactness of J, for any < 9 < 1, we can choose 
z\, . . . , ZM n (B) G •/ with M n {8) < oo such that, for all z £ J, 



sup mm 

se gl<i<M„(S) 



[ 5 ( x )_ 5 ( 2; + / l -l/rf( Zi _ z ))]2 dx < 



and, further, we can do this so that 

(4.37) sup min h~ l/d \z - zA 9 -> as 9 \ 0, 

ze jl<i<M n (0) n 12 

and for some function C (9) < oo for 9 > 0, 

(4.38) M n (9) < C (9) h^ 1 . 

Next, for any < 9 < 1, z £ J, let z(#) denote a selection of a Zj among 
2i,---,«M n ((?) satisfying 

(4.39) sup / [ 5 (x)- 5 (x + / l - 1/d (2(0)-z))] 2 dx<0. 

Moreover, we do this in such a way so that 

(4.40) suph~ 1/d \z- z(9)\ 2 ^0 as9\0. 



Lemma 5. There exists a r > such that, for all < 9 < 1 and large 
enough n, 

(4.41) sup sup E(g(h- l / d (z - Z)) - g{h-^ d {z(8) - Z))f < r 2 9h n . 

PROOF. Notice that 
Eigih-^iz - Z)) - g(h- 1 ' d (z(9) - Z))f 

< E[E{g{h- l ' d {z - Z)) - g(K 1 / d (z(9) - Z))f\Z £ n n (z, z(9))}, 

where VL n (z,z(9)) = (z — hl/ d I d )U(z(8) — hl/ d I d ). Now this last bound equals 

In n(zA 0)) \9(hn 1/d (z - y)) - g{h- 1/d (z(9) - y))ff{y) dy 



p(n n (z,z(0))) 

■-:I„(z,z(p)). 



-p(n n (z,z(9))) 



Clearly, for all large enough n, uniformly in z 6 J, £l n (z, z{9)) C J 7 . Thus by 
using the fact that, with A denoting Lebesgue measure, h n < X(Q n (z, z(9))) < 
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2/i2; along with (4.18), we get, for all large enough n, uniformly in z G J and 
9^0, 

I n (z,z{9)) < ^ — ^ — 2/3 2 /i„ 

n n p\ 

< / Rrf [g(^ 1/d (^-y))-g(^ 1/d (^)-y))] 2 /? 2 ^ 0/? , 

h n Pl 

which by the change of variables x = /i n 1 ^(z — y) and (4.39) 

= ^(x)- 9 (x + hn 1/d (z(e)-z))?dX 2plhn ^ wleK/ ^ 
Pi 

Thus we have (4.41) with r 2 = 2/3f//3 1 . □ 

For each z £ J and /i > 0, let 5 n ( • ; z, /i) denote the function from £/ to R 
defined, for each g G Q, to be 

(4.42) S n ( 5 ; 2, /») = (vTMr 1 IX^ -1 /^ " ^)) " ^(^ V "(^ - ^))}- 

3=1 

Now for any < 9 < 1, with 2(0) and M n {6) satisfying (4.37)~(4.40), set 



and 



w n\ e ) = ^ n 1 supsup|5 , n (5r;z,/i„) - V f(z(0))/f(z)S n (g;z(6),h n )\ 
zeJ g&G 



w<®{0) = 5(6)b- 1 supsup|5 n ( 9 ; z(ff),K)\> 



where b n is as in (4.1) and 5(6) = sup^ g j \\/ f(z(9))/ f(z) — 1|. Notice that 

supsup|L n (z, 5 ) - L n (z(6),g)\ < m$ (0) + (0) , 
zeJ geg 

from which we get that, for any r] > and < 6 < 1, 

P{L n (z, •) €" 5q for some z G J} 

Af„(0) 

(4.43) < £ P{£n(^,0^^ /2 } 

i=l 

+ P{^)(0) > r//4} + P{*4 2 >(0) > 7?/4}. 

To complete the proof of part (a) of Theorem 1, we need the following 
generalization of the Ottaviani inequality. 
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4.2.1. A generalized Ottaviani inequality. Let {S m (t) :t G A,0 < m < n}, 
n > 1, be an indexed set of random processes such that, for each t G A and 
1 < m < n, S m (t) G 5, where A is a countable set and 1? is a separable 
Banach space with norm || • ||. Also assume that, for each 1 < m < n, 

(AAA\S n {t) - S m (t) : t G A} is independent of {S k (t) : t G A, 1 < k < m}. 

Further assume that, for some r > 0, 

(4.45) max supP{||S„(t) - S m (t)\\ > r} =: c < 1, 

0<m<n 

where So(t) = for all t G A. For any Borel subset Ac B, n>l and 5 > 0, 
set A 5 = {x : inf y€j 4 ||x — y\\ < 5}, 

C n (5) = {S m (t) A s for some t £ A and 1 < m < n} 

and 

D n {8) = {S„(t) i A 5 for some t G A}. 
We shall prove the following extension of Ottaviani's inequality. 

Lemma 6. With r > and < c < 1 as in (4.45), for all Borel subsets 
Ac B, and e > 0, 

(4.46) P{C n (e + r)} < (1 - c)~ l P{D n (e)} . 

Proof. Let tj, % = 1,2, . . . , be an enumeration of the set A and define 
the events for 5 > 0, i = 1, 2, . . . , and 1 < m < re, 

D i>m (S) = {S m (U) i A 6 }, D rn (5) = |J Di, m (S) 

i>l 

and 

F l , m (S)={\\Sn(ti)-S m (t i )\\<5}. 

We define D ijQ (S) = and D (5) = 0. We get that 

P{C n (e + T)} = J2Y,P A, ? (e + r) f) Dj; ff (e + T) f) A C (e + r) , 
=ii=i I j<i-l fe<g-l J 

where A c denotes the complement of the event A. We see by (4.44) that, for 
any 5' and 5" > 0, the sequences of events {Di ;m (5') : i > 1} and {Fi^ m {5") : i > 
1} are independent. Therefore by (4.45), 

(l-c)P{C n (e + r)} 

= min MP{F i>m (r)}P{C n (e + T)} 

Km<n «>1 
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<EE P A, 9 (e + r)nF^(r) f| D? q {e + r) f) D%(e + r)\ 

i=lq=l { j<i-l k<q-l ) 

<p!^jD i>n (s)^=P{D n (s)}. d 

The ideas used in the proof of Lemma 6 go back at least to Lemma 2.3 
of James (1975). 

Returning now to the proof of part (a) of Theorem 1 and recalling (4.34), 
consider, for any £,7 > and k> 1, the sets 

C fc (e,7) = {b~l +1 S n {- ;z,h Uk+1 ) Sq for some v k <n< u k+1 and z £ J} 

and 

Ac(e,7) = {Kk +1 S iy k +i(- ;^^ fc+ i) i $0 for some zeJ}. 

It is elementary to verify using Inequality 1 that, for any e > 0, all 7 > 
small, depending on e, and all large enough k, 

max supP{b~^ \\S Uk+1 (- ; z, h Uk+1 ) - S m (- ; z, h u k+1 )\\^ > e/2} < 1/2. 

Thus, since with probability 1, the values of S n (- ; z, h Uk+1 ), v k < n< Vk+i, 
z £ J, are determined by a countable subset of J, it is clear that we can 
apply the generalized Ottaviani inequality to give, for all large k, 

P{C k (e,j)} < 2P{D k {e/2 ll )} = 2P{L Uk+1 (z, •) $ S £ /2 for some z G J}, 
which by inequality (4.43) is 

<2 J2 P{L, k+1 (zi,-)^S £ /4 } + 2P{wW +1 (9)>e/8} 

i=l 

+ 2P{w ( S +1 (9)>e/S} 

=■ Qi,k( £ ) + Q2,k( £ ) + QsM 6 )- 

First, by choosing 9 > sufficiently small and using the fact that (4.40) 
implies that 5(9) — > 0, as 9 \ 0, along with (4.41), one can easily show using 
Inequality 1 that 

00 

Y,(Q*M £ ) + QaA £ )) <0 °- 

k=l 

Next, by applying part (i) of Proposition 1 with m n = M Uk+1 (9), in combi- 
nation with Fact 6 with m n = 1, it is straightforward to check that, for some 
7] > and all large k, 

Qi,k( e ) < M » k+ i (*) ex P(-(! + V) log(l/^ fc+1 )), 
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which by (4.38) and log(l//i i/)t+1 )/log(A;) — > oo, following from (H.iii), implies 
that X)fc^=i Qi,k( £ ) < 00 • Thus for any e > and all 7 > small, depending 
on e, using the Borel-Cantelli lemma and the above string of inequalities, 
we obtain that 

(4.47) P{C k (e,-y), i.o. in A; > 1} = 0. 
Observing that for < n < fk+i, 

(b n /b Uk+1 )L n (z, g((h n /h Uk+1 ) 1/d ■ )) = S n ( ■ ; z, h Uk+1 )/b Uk+1 , 

the remainder of the proof of part (a) is now easily inferred from (4.47) and 
Lemma 4. 

4.3. Proof of Corollary 1. First note that the assumption that the den- 
sity / is uniformly continuous on R d is equivalent to the assumption that / 
is continuous on R rf and satisfies the condition that 

lim sup{/(z) : \z\^ > R} = 0, 

R^oo 

from which we readily infer that to = sup zgR d \J f(z) < 00. Furthermore, 
/ continuous on M. d implies that, for all c > 0, the set {z:c> f(z) > 0} is 
nonempty. 

Define the compact set J = {z:c< f(z) and \z\2 < 2i?}, where c> and 
R are chosen so that J has nonempty interior and with D\ as in Inequality 
1 and k the bound on the functions in Q, 

(4.48) sup{v7W : N2 > R} < Vc< V(6v^kDi). 

Now since / is assumed to be uniformly continuous, we can choose a 7 > 
so that 

f(z) > c/2 for all z G J 7 . 

Thus we can apply Theorem 1 to conclude that, for all e > 0, there exists 
an n(e) such that for each n > n(e), {L n (z, ■): z £ J} C <Sg, which clearly 
implies that {D n (z, •) : z E J} C tqSq. Obviously now, to complete the proof 
of the first part of Corollary 1, it suffices to show that 

(4.49) limsup sup sup \D n (z, g)\ < tq/2 a.s., 

where Br = {z : \z\2 > R}- The proof will follow from blocking between 2 fc 
and 2 k+l and using Inequality 1. Notice that since each g E Q is bounded by 
K > 0, we get, for each n > 1, z E -Br and g £Q, 

Eg 2 {h- l l d (z - Z)) < K 2 h n f * H hn (z), 
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where H{x) = I{x G I d }, which by Lemma 1, for all n large enough uniformly 
in z £ Br, is 

< K 2 h n (f(z) + c) < 2cK 2 h n . 

Thus with n/j := 2 fc , fc = 1,2, . .. , using (H.i), we get, for all large enough 
k> 1, 

max sup sup£^<7 2 (/i~ 1//d (z — Z)) < 4cK 2 h n , . 

Set, for A; = 1, 2, ... , 

J" nfc+1 = {g{h-y d {z -.)) :g€ g,ze B R , 2 k < n < 2 k+1 }. 
Now with D\ as in Inequality 1, 

Pi max sup sup \D n (z,g)\> V2{2k^+ kVc)D! \ 

l2 fc <n<2 fe +! z€ B R geg J 

< Pi max ||T n ||^ > (2k^ + K^)Dib nk+1 \, 

ll<n<n k+1 k + 1 J 

which since J~n k+1 satisfies (F.ii-iii) is, by Inequality 1, with p = k^/c and 
7 = 2k^/c, 

<2exp(- J D 4^ 1 log(l// infc+1 )). 

Since log(l/7i nfe+1 )/log(&) — >oo, this last bound, the Borel-Cantelli lemma 
and (4.48) imply that (4.49) holds, which completes the proof of part (a) of 
Corollary 1. 

Whenever f{z) > 0, part (b) of Corollary 1 is proved by applying part (b) 
of Theorem 1 on closed balls B$(z) = {x : \x — z\% < 5} of radius 5 > around 
z, where 5 > is sufficiently small, and when f(z) = we apply a straight- 
forward modification of the argument given in the previous paragraph to 
closed balls Bg(z) around z to show that 

limlimsup sup sup \D n (z,g)\ = a.s. 
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